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30 BACKGROUND OF THE INVENTION 



Field of the Invention 

This invention relates to the field of application development. In particular, the 
invention relates to technologies for developing interactive telephone applications. 
Description of the Related Art 
35 Prior techniques for developing telephone applications have required the application 

developer, also known as a programmer, to use specialized development software and/or 
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hardware. For example, if a developer wanted to create phone applications using Nuance(TM) 
voice recognition software, from Nuance Communications, Menlo Park, California, they 

would have to set up a specialized development computer system, obtain the required 
telephony equipment, obtain suitable development tools (e.g. compilers), as well as obtain and 
5 install the necessary speech recognition system. 

This cumbersome process drastically limits the number of people who can develop 
and deploy phone applications. Further, the software license fees and hardware costs 
associated with obtaining the necessary tools limit who can be a developer. For example, an 
individual developer might need to obtain, configure, and have licenses to a variety of tools 
10 including: a speech recognizer, a speech programming toolkit, the target interactive voice 

response (IVR) system or telephony cards, a compiler, a comprehensive understanding of the 
grammars supported by the speech recognizer, and/or other specialized materials. 

Further, emerging standards such as VoiceXML, see <http://www.voicexml.org/>, do 
not come pre-packaged with programming tools and development environments. This is in 
15 stark contrast to other World Wide Web Consortium (W3C) standards such as hypertext 
markup language (HTML) which is widely deployed in browsers such as Internet 
Explorer(TM) from Microsoft Corporation, Redmond, Washington. Further, like HTML, 
specific platforms may provide implementation specific features that differ slightly from one 
provider to another. 

20 The prior approaches to phone application development required proprietary tools that 

limited the ability of individuals to rapidly develop phone applications without specialized 

software and/or hardware. Accordingly, what is needed is a method and apparatus for 
developing phone applications that allows users with standard hardware and software, e.g. 
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personal computer with Internet access, and a telephone to develop phone applications. The 
method and apparatus should support debugging of telephone applications as well as shared 
code reuse of VoiceXML components, grammars, audio prompts, sound files, and/or other 
phone application features. Further, the method and apparatus should minimize the need for 
5 the developer to understand the intricacies related to defining grammars by allowing the 
developer to easily define grammars in their phone applications and also leverage packaged 
grammars. Further, the method and apparatus should support rapid deployment of a phone 
application into a hosted environment for use by end users of the application. 

SUMMARY OF THE INVENTION 

10 A zero-footprint remotely hosted phone application development environment is 

described. The environment allows a developer to use a standard computer without any 
specialized software (in some embodiments all that is necessary is a web browser and network 
access) together with a telephone to develop sophisticated phone applications that use speech 
recognition and/or touch tone inputs to perform tasks, access web-based information, and/or 
1 5 perform commercial transactions. 

For example, in preparation for a sales pitch for selling hosting services, a 

non-programmer could easily develop a short application appropriate to the target customer. 
After the pitch, a developer id code (and password) could be left with the target customer to 
allow them to more fully develop the application. Further, when the target customer is 
20 satisfied with the application, they can complete any necessary legal agreements for hosting 
and have their application live for their actual (as opposed to test) users at a suitable phone 
number without any changes. The development environment can be configured to behave 
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identically (any extensions, features, libraries, modules, etc.) to the hosting environment so as 
to avoid any surprises due to incompatibilities. 

Development is accomplished primarily by identifying an entry point into the phone 

application, e.g. the URI of the start of the application, to the development environment. The 
5 developer can then immediately use a telephone to call the application on the remotely-hosted 
development environment and test it out. Alternatively, the application itself can be prepared 
m the browser using a scratchpad mode. 

Call flow tracking that is concurrent with placed calls allows the developer to observe, 
3 using a web browser, the execution of her/his application in some embodiments of the 

;|J 10 invention. Other call flow, or debugging, features are customizable to allow the developer 
; J flexibility to debug and monitor the behavior of her/his application. 

A variety of reusable libraries can be provided to enable the developer to leverage 
CP well-developed libraries for common playback, input, and computational tasks. This focuses 

;^ the development on application specific logic. For example, high quality audio recordings of 

15 commonly used phrases, terms, etc., can be provided, e.g., times, durations, dates, monetary 

values, cities/states, credit card numbers, phone numbers, etc. Similarly, high quality 

grammars can be provided for recognizing common types of input. Other modules and utility 
functions may provide programmatic methods to the developer. Many of these libraries can be 

packaged to preserve the opacity of the implementation, e.g. limit access by the developer to 
20 the underlying implementation/source. 



TM00-004 US Application doc 



5 



Attorney Docket Number TMOO-004 US 



BRIEF DESCRIPTION OF THE FIGURES 

Fig. 1 illustrates a system including embodiments of the invention used to support 

remotely hosted phone application development. 

Fig. 2 illustrates the components of a phone application platform supporting remotely 

5 hosted phone application development. 

Figs. 3-6 are screen shots of web pages presented by the remotely hosted phone 
application development environment to developers. 

Fig. 7 is a process flow chart for developing an application using the remotely host 
phone application development environment. 
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DETAILED DESCRIPTION 

A. Introduction 

A remotely hosted method and apparatus for developing telephone applications is 
described. This allows developers, or programmers, to easily create phone applications 
5 without the need for specialized hardware or software on their local machines. Applications 
developed using the system can then be deployed, or hosted, in a platforms such as a voice 
portal, an interactive voice response (IVR) system, and/or some other voice access medium. 

End users of phone applications can use telephones, including cellular telephones, to 
access the phone applications and retrieve information, purchase goods and services, and/or 
10 complete other tasks. In some embodiments of the invention, the applications are able to 

retrieve information from the World Wide Web (WWW), databases, third parties, and/or other 
sources. 

The features that developers can offer in their telephone application are constrained by 
the limitations — but also receive the advantages — of the particular implementation platform. 
15 For example, some platforms can receive dual-tone multi-frequency (DTMF or touch-tone) 

commands as well as spoken commands to further control the content presented and direct 
commerce transactions as well as the manner of presentation. The term audio request, or 
input, is used to refer to either a voice or touch-tone input, or a combination of the two types 

of input, 

20 Similarly, different platforms may allow different levels of access to telephone 

identifying information. Developers may wish to use telephone identifying information to 
personalize caller interactions with their applications. Also, some platforms may provide a 
uniform state management mechanism for phone applications. 
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Applicants note several commonly owned and assigned co-pending patent applications 
relating to features provided by phone application platforms such as a voice portal: 

Serial # Title Filing Date 

09/466,236 Method and Apparatus for Electronic 1 7 Dec 1 999 

Commerce Using a Telephone Interface 

09/426, 1 02 Method and Apparatus for Content 22 Oct 1 999 

Personalization over a Telephone Interface 

The invention will be described in greater detail as follows. First, a number of 

definitions useful to understanding the invention are presented. Then, the hardware and 

5 software architecture for the remotely hosted development environment are presented. 

Finally, the processes and features of the remotely hosted development environment are 

presented in greater detail. 

B. Definitions 

1 . Telephone Identifying Information 
10 For the purposes of this application, the term telephone identifying information will be 

used to refer to ANI information, CID information, and/or some other technique for 
automatically identifying the source of a call and/or other call setup information. For example, 
telephone identifying information may include a dialed number identification service (DNIS). 
Similarly, CID information may include text data including the subscriber's name and/or 
15 address, e.g. "Jane Doe". Other examples of telephone identifying information might include 
the type of calling phone, e.g. cellular, pay phone, and/or hospital phone. 

Additionally, the telephone identifying information may include wireless carrier 
specific identifying information, e.g. location of wireless phone now, etc. Also, signaling 
system seven (SS7) information may be included in the telephone identifying information. 
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2. User Profile 

A user profile is a collection of information about a particular user. The user profile 
typically includes collections of different information of relevance to the user, e.g., account 
number, name, contact information, user-id, default preferences, and the like. Notably, the 
5 user profile contains a combination of explicitly made selections and implicitly made 
selections. 

Explicitly made selections in the user profile stem from requests by the user to the 
system. For example, the user might add business news to the main topic list. Typically, 
explicit selections come in the form of a voice, or touch-tone command, to save a particular 

10 location, e.g. "Remember this", "Bookmark it", "shortcut this", pound (#) key touch-tone, 
etc., or through adjustments to the user profile made through the web interface using a 
computer. 

Additionally, the user profile provides a useful mechanism for associating telephone 
identifying information with a single user, or entity. For example, Jane Doe may have a home 
1 5 phone, a work phone, a cell phone, and/or some other telephones. Suitable telephone 

identifying information for each of those phones can be associated in a single profile for Jane. 

This allows the system to provide uniformity of customization to a single user, irrespective of 
where they are calling from. 

In contrast, implicit selections come about through the conduct and behavior of the 
20 user. For example, if the user repeatedly asks for the weather in Palo Alto, California, the 

system may automatically provide the Palo Alto weather report without further prompting. In 
other embodiments, the user may be prompted to confirm the system's implicit choice, e.g. the 
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system might prompt the user "Would you like me to include Palo Alto in the standard 
weather report from now on?" 

Additionally, the system may allow the user to customize the system to meet her/his 
needs better. For example, the user may be allowed to control the verbosity of prompts, the 
5 dialect used, and/or other settings for the system. These customizations can be made either 

explicitly or implicitly. For example if the user is providing commands before most prompts 

are finished, the system could recognize that a less verbose set of prompts is needed and 
implicitly set the user's prompting preference to briefer prompts. 

3. Topics and Content 

10 A topic is any collection of similar content. Topics may be arranged hierarchically as 

well. For example, a topic might be business news, while subtopics might include stock 
quotes, market report, and analyst reports. Within a topic different types of content are 
available. For example, in the stock quotes subtopic, the content might include stock quotes. 
The distinction between topics and the content within the topics is primarily one of degree in 

15 that each topic, or subtopic, will usually contain several pieces of content. 

4. Demographic and Psychographic Profiles 

Both demographic profiles and psychographic profiles contain information relating to 

a user. Demographic profiles typically include factual information, e.g. age, gender, marital 
status, income, etc. Psychographic profiles typically include information about behaviors, e.g. 
20 fim loving, analytical, compassionate, fast reader, slow reader, etc. As used in this application, 
the term demographic profile will be used to refer to both demographic and psychographic 
profiles. 
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C. Voice Portal Overview 

1. Hardware and Software Architecture 

First, the hardware and software architecture of a system including an embodiment of 
the invention will be described with reference to Figures 1-2. Figure 1 illustrates a system 
5 including embodiments of the invention used to support remotely hosted phone application 
development. The system of Figure 1 can be used to allow developers with a standard 
computer and a telephone, or cellular telephones, to develop telephone applications without 
the need for specialized hardware and/or software. 

The following lists the elements of Figure 1 and describes their interconnections. 

10 Figure 1 includes a telephone 100, a computer 102, a telephone network 104, an Internet 106, 
a telephone gateway 107, a development platform web server 108, a phone application 
platform 1 10, a web server 101 and a phone application 1 14. The telephone 100 is coupled in 
communication with the telephone network 104. The telephone network 104 is coupled in 
communication with the telephone gateway 107. The telephone gateway 107 is coupled in 

15 communication with the phone application platform 110. The computer 102 is coupled in 

communication with the Internet 106. The Internet 106 is coupled in communication with the 
web server 108, the web server 101, and the phone application platform 110. Additionally, not 

shown in Figure 1, a shared database 112 may provide a common storage for the development 
platform web server 108 and the phone application platform 110. 
20 The following describes each of the elements of Figure 1 in greater detail. The 

telephone 100 is a telephone interfaces to the phone application platform 1 10. The telephone 
100 may be any sort of telephone and/or cellular telephone. For example the telephone 100 or 
may be a land line phone, a PBX telephone, a satellite phone, a wireless telephone, and/or any 
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other type of communication device capable of providing voice communication and/or touch- 
tone signals over the telephone network 104. However, any audio signal carrying interface 
could be used. 

The telephone network 104 may be the public switched telephone network (PSTN) 
5 and/or some other type of telephone network. For example, some embodiments of the 

invention may allow users with a voice over Internet Protocol (IP) phone to access the phone 
application platform 110. The telephone network 104 is coupled to the telephone gateway 107 

that allows the voice communications and/or touch-tone signals from the telephone network 
104 to reach the phone application platform 1 10 in usable form. Similarly, the telephone 

10 gateway 107 allows audio signals generated by the phone application platform 1 10 to be sent 
over the telephone network 104 to respective telephones, e.g. the telephone 100. The 
telephone network 104 generally represents an audio signal carrying network. 

The computer 102 is a computer such as a personal computer, a thin client computer, a 
server computer, a handheld computer, a set top box computer, and/or some other type of 

15 visual web browsing device. The computer 102 is coupled in communication with the Internet 
106, e.g. by a dial-up connection, a digital subscriber loop (DSL), a cable modem, and/or 
some other type of connection. This allows the computer 102 to communicate with the web 
server 108 and the web server 101. The computer 102 typically provides a visual interface to 
the WWW and the web server 108 using web browsing software such as Internet 

20 Explorer(TM) from Microsoft Corporation, Redmond, Washington. 

The web server 101 is any web server to which the developer has access. In some 
instances, the web server 101 maybe hosted on the computer 102. For example, versions of 
Windows(TM) from Microsoft Corporation Redmond ? Washington can support a web server 
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for allowing one or more files local to the computer 102 to be accessed over the Internet 106 
using a web protocol, e.g. hypertext transfer protocol (HTTP), file transfer protocol (FTP), 
and/or some other protocol. In other instances, the web server 101 may be hosted on 
computers of the developer's Internet service provider (ISP). 
5 The development platform web server 108 includes one or more web based 

applications for providing the web portion of the remotely hosted development environment. 
The features of the development platform web server 108 are described in greater detail 
below. 

Figure 2 illustrates the components of a phone application platform supporting 

10 remotely hosted phone application development. This could be used to support the phone 

application platform 110 and allow for remotely hosted phone application development. This 
description describes one particular phone application platform; however, the remotely host 
application development method and apparatus are not particular to this phone application 
platform. 

15 The following lists the elements of Figure 2 and describes their interconnections. The 

phone application platform 1 10 is coupled in communication with the telephone gateway 107. 
The phone application platform 110 includes a call manager 200, an execution engine 202, a 
data connectivity engine 220, an evaluation engine 222 and a streaming engine 224. 
Additionally Figure 2 includes elements that may be included in the phone application 

20 platform 1 1 0, or which may be separate from, but coupled to, the phone application platform 
110. Thus Figure 2 also includes a recognition server 210 ? an audio server 213, a text to 
speech server 214, an audio repository 212, the shared database 1 12, a database 226, the 
Internet 1 06, a database 228 and a web site 230. The call manager 200 within the phone 
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application platform 1 10 is coupled to the execution engine 202. The execution engine 202 is 

coupled to the recognition server 210, the audio server 213, data connectivity engine 220, the 

evaluation engine 222 and the streaming engine 224. The data connectivity engine 220 is 
coupled in communication with the shared database 1 12, the database 226 and the Internet 

5 106. The Internet 106 is coupled in communication with database 228 and the web site 230. 
The audio server 213 is coupled to the text to speech server 214 and the audio repository 212. 

The following describes each of the elements of Figure 2 in greater detail. In some 
embodiments of the invention, the phone application platform 1 10 is implemented using one 
or more computers. The computers may be server computers such as UNIX workstations, 

1 0 personal computers and/or some other type of computers. Each of the components of the 

phone application platform 110 may be implemented on a single computer, multiple 
computers and/or in a distributed fashion. Thus, each of the components of the phone 
application platform 1 10 is a functional unit that may be divided over multiple computers 
and/or multiple processors. The phone application platform 1 10 represents an example of a 
1 5 telephone interface subsystem. Different components may be included in a telephone interface 
subsystem. For example ? a telephone interface subsystem may include one or more of the 
following components: the call manager 200, the execution engine, the data connectivity 220, 

the evaluation engine 222, the streaming subsystem 224, the audio repository 212, the audio 

server 213, the text to speech 214 and/or the recognition engine 210. 
20 The call manager 200 is responsible for scheduling call and process flow among the 

various components of the phone application platform 110. The call manager 200 sequences 
access to the execution engine 202. Similarly, the execution engine 202 handles access to the 
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recognition server 210, the audio server 213, the data connectivity engine 220, the evaluation 
engine 222 and the streaming engine 224. 

The recognition server 210 supports voice, or speech, recognition. The recognition 
server 210 may use Nuance 6(TM) recognition software from Nuance Communications, 
5 Menlo Park, California, and/or some other speech recognition product. The execution engine 
202 provides necessary grammars to the recognition server 210 to assist in the recognition 

process. The results from the recognition server 210 can then be used by the execution engine 

202 to further direct the call session. Additionally, the recognition server 110 may support 
voice login using products such as Nuance Verifier(TM) and/or other voice login and 

10 verification products. Additionally, not shown in the figure, the recognition server 210 may 
use HTTP, or other suitable protocols, to retrieve grammars identified using a uniform 
resource indicator (URI) from servers. These requests can access servers across the Internet 
106, e.g. a grammar stored on the web site 230. 

The audio server 213 provides audio playback capabilities and uses a text to speech 

1 5 server 214 and an audio repository 212 to obtain some of the sounds presented in the system. 
According to one implementation, the <AUDIO> VoiceXML tag is supported in such a 
fashion that if the requested SRC file cannot be obtained, the text to speech server 214 is 
requested to generate speech for the tag contents. For example, "<AUDIO 
SRC="number98.wav">98</AUDIO>" would result in the audio server 213 first attempting 

20 to retrieve the source file "number98.wav" from the audio repository 212, or other specified 
server using HTTP, or other suitable protocols. If the file is unavailable, cannot be retrieved, 
or cannot be retrieved in a timely enough fashion, the text to speech server 214 is 
automatically called to generate the speech synthesized version of the number "98", 
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Additionally, the audio server 213 can adjust the timing, balance, and eliminate audio 
artifacts (e.g., "clean") in the sounds being played back so as to provide an aurally smooth and 

pleasing sound to the user. Further, when appropriate, the execution engine 202 may batch a 

group of <AUDIO> and <PAUSE> commands together and to pass them to the audio server 
5 213. This allows for the most natural playback of sounds from a timing standpoint. The basic 
grouping criteria is that there be no intervening commands unrelated to audio playback. 

Additionally, the audio server can support retrieval of non-static materials, e.g. 

streaming audio, audio data feeds, and/or other types of audio data. Embodiments of the 
invention may include appropriate software for accessing common streaming protocols and 

10 their data streams, e.g. RealAudio(TM), RealVideo(TM), QuickTime(TM), etc., using the 
audio server 213. 

The text to speech server 214 supports the conversion of text to synthesized speech for 
transmission over the telephone gateway 107. For example, a request that the phrase, "The 

temperature in Palo Alto, California, is currently 58 degrees and rising" be spoken to a caller 

15 could be made. That phrase would be translated to speech by the text to speech server 214 for 
playback over the telephone network on the telephone (e.g. the telephone 100). Additionally 
the text to speech server 214 may respond using a selected dialect and/or other voice character 

settings appropriate for the caller. 

The audio repository 212 may include recorded sounds and/or voices. In some 
20 embodiments the audio repository 212 is coupled to one of the databases (e.g. the database 
226, the database 228 and/or the shared database 112) for storage of audio files. The audio 
repository server 212 responds to requests to play a specific sound or recording. According to 



TMOO-004 US Application doc 



16 



Attorney Docket Number TMOO-004 US 



some embodiments of the invention, the audio repository 212 is accessed according to the 
hypertext transfer protocol (HTTP). 

For example, the audio repository 212 may contain a standard voice greeting for 
callers to the phone application platform 1 10, in which case the execution engine 202 could 

5 request play-back of that particular sound file. The selected sound file would then be 

delivered by the audio repository 212 through the call manager 200 and across the telephone 
gateway 107 to the caller on the telephone, e.g. the telephone 100. Additionally, the telephone 

gateway 107 may include digital signal processors (DSPs) that support the generation of 
sounds and/or audio mixing. 
10 The execution engine 202 supports the execution of multiple threads with each thread 

operating one or more applications for a particular call to the phone application platform 110. 

Thus, for example, if the user has called in to the phone application platform 1 10, a thread 
may be started to provide her/him a voice interface to the system and for accessing other 
options. 

15 In some embodiments of the invention an extensible markup language (XML)-style 

language is used to program applications. Each application is then written in the XML-style 
language and executed in a thread on the execution engine 202. In some embodiments, an 
XML-style language such as VoiceXML from the VoiceXML Forum, see 
<http://www.voicexml.org/>, is extended for use by the execution engine 202 in the phone 

20 application platform 110. 

Additionally, the execution engine 202 may access the data connectivity engine 220 
for access to databases and web sites (e.g. the shared database 1 12, the web site 230), the 
evaluation engine 222 for computing tasks and the streaming engine 224 for presentation of 
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streaming media and audio. The streaming engine 224 may allow users of the phone 
application platform 1 10 to access streaming audio content, or the audio portion of streaming 
video content, over the telephone interface. For example, a streaming media broadcast from 

ZDNet(TM) could be accessed by the streaming engine 224 for playback through the voice 

5 portal. 

The data connectivity engine 220 supports access to a variety of databases including 
databases accessed across the Internet 106, e.g. the database 228, and also access to web sites 
over the Internet such as the web site 230. In some embodiments the data connectivity engine 
can access standard query language (SQL) databases, open database connectivity databases 
10 (ODBC), and/or other types of databases. The shared database 1 12 is represented separately 
from the other databases in Figure 2; however, the shared database 1 12 may in fact be part of 
one of the other databases, e.g. the database 226. Thus ? the shared database 1 12 is 
distinguished from other databases accessed by the phone application platform 1 10 in that it 

contains user profile information. 

15 A summary of the phone application platform features provided according to some 

embodiments of the invention follows. Then, the processes and features of the remotely 
hosted development environment are presented in greater detail. 

2. Phone Application Platform Features 

According to some embodiments of the invention, the phone application platform 
20 supports a Voice Extensible Markup Language (VoiceXML) standard such as the VoiceXML 

specification 1,0, 7 March 2000, with extensions and some implementation specific 

limitations. 
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For example, according to some embodiments, a VoiceXML specification is extended 
so that the phone application platform 110 can recognize a <DEBUG> command. In some 
embodiments of the invention, the container contents between <DEBUG> and </DEBUG> 
are automatically included in the debugging information provided to developers performing 
5 remotely hosted development. Similarly, Javascript(TM) methods are provided for outputting 
debugging information according to some embodiments of the invention where 
Javascript(TM) is supported within phone applications. 

The specific platform features are not highly relevant except as they relate to the 
general problem of phone application development. That is because if Company X and 
10 Company Y have different platform features, then a developer who was using traditional 
phone application development techniques might need different specialized hardware and 
software to develop for each platform. In contrast according to embodiments of the present 

invention, the developer would not need to maintain any specialized hardware and/or software 
for developing for the phone application platform 110. 
15 For the remainder of this discussion, an XML based phone application programming 

language is considered. The processes and features of the remotely hosted development 
environment will now be presented. 

D. Remotely Hosted Development Environment 

Figures 3-6 are screen shots of web pages presented by the remotely hosted phone 
20 application development environment to developers. Figure 7 is a process flow chart for 
developing an application using the remotely host phone application development 
environment. The process of Figure 7 will be described with reference to Figures 3-6. The 
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process of Figure 7 and the corresponding screen shots could be implemented using the 

software and hardware architecture described in conjunction with Figures 1 and 2. 

The process starts at step 700, where a developer registers and/or logs in to the 

development environment, e.g. by identifying herselfThimself to a web-based application on 
5 the development platform web server 108. The policy decisions surrounding who can register 
can be set by the operator of the remotely hosted phone application development 
environment. Similarly, the operator can determine other policy decisions such as whether 

there is a charge for using the development environment and the nature and format of that 
charge. Other policy decisions include whether the developer has to pay for the calls to the 

10 test her/his phone application, e.g. use of 800-number versus regular toll call. 

Next, at step 702, the developer is given access to the development environment. An 
initial web page of the development environment according to one embodiment of the 
invention is shown as Figure 3. An identifier 300 is assigned to each developer to identify that 
developer, e.g. a five-digit number. In this example, the identifier 300 has been masked out in 

15 Figure 3, for the remainder of this discussion the identifier 12345 will be used. Also, a call in 
number 302 is provided, again the last portion of the call in number is masked out. 

Different developers maybe given different call-in numbers on a per session basis, on 
a permanent basis, or based on their affiliation with the operator of the remotely hosted phone 
application platform. For example, preferred developers might be provided an 800-number 

20 call-in number while other developers were provided a non-free phone number. Similarly, if 
the phone application platform 1 10 is implemented in a distributed fashion across multiple 
call-in numbers, the call-m number may be dynamically returned. 
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The ability of phone calls to occur asynchronously relative to the development process 
is shown in Figure 7 by the block 760. According to some embodiments of the invention, the 
applications being developed can be accessed by multiple users simultaneously at the call in 
number 302. In some embodiments, a different call in number is provided to developers for 
5 access to their application when not logged in to the system, e.g. if giving a demonstration, 

etc, 

Similarly, block 750 shows the asynchronous process whereby a developer makes 
edits to the application file, or files. For example, a developer can modify the application file, 

e.g. the application file 1 14, using a text editor, e.g. NOTEPAD.EXE under Windows(TM) 

10 operating system ("OS"), vi or emacs under a UNIX(TM) OS variant, BBEdit(TM) editor on 
a Macintosh(TM) platform, and or some other type of text editor. Similarly, the developer can 
place audio files, e.g. in WAV format, on the web server 101, and/or other materials 
appropriate to her/his phone application. For example, in some instances a phone application 
may call a Common Gateway Interface (CGI) program on the web server 101 to 

1 5 retrieve/return a result. The developer can asynchronously edit any CGI programs as well. 
Also, the program file itself maybe dynamically generated by another program, e.g. a CGI 
program. 

As a note, many personal computers come with built in web server capabilities, e.g. 
Macintosh(TM) computers include the Apple(TM) Personal Web Sharing software for 
20 sharing the contents of a folder, similar software is available and/or included with most other 

computers, e.g. Windows(TM) computers, Linux(TM) computers, etc. Accordingly, the 
developer may not even need to upload her/his files to the web server 101. Instead, in such 
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configurations, she/he just stores them in a suitable location on her/his computer 102, which is 
acting as the web server 101. 

Returning to the process flow of Figure 7, two primary modalities are provided for 
application development according to some embodiments of the invention: reference, or URI, 
5 based development and direct in browser, or scratchpad, based development. These are 
represented in Figure 7 by steps 704 and 706 respectively. 

1. Reference/URI Based Development 

Figure 3 shows an example of the URI type development of step 704. An application 
URI field 304 is provided in the web based development environment to identify the URIs of 
10 one or more applications. In the example of Figure 3, only a single URI is permitted at a given 
time. In this instance the application file 1 14 is identified by the URI 

<http://www.valdemar.net/erik/grocery.vxml>. The URI serves as a reference, or pointer, to 
the actual application code for the phone application platform 110. According to some 
embodiments of the invention, a developer makes her/his application available for testing at 

15 the call in number 302 by submitting the URI to the development platform web server 108, 
e.g. by clicking an HTML form submit button. Upon submission, the development platform 

web server 108 sends appropriate messages and/or updates suitable shared data, e.g. in the 

shared database 1 12, to notify the phone application platform 1 10 to make the referenced 
phone application available. 
20 Some embodiments of the invention may allow the developer to store multiple URIs. 

In those configurations, depending on the choices made by the operator of the remotely hosted 
phone application development platform, may either have to chose a single "active" 
application for the call in number or may automatically be prompted when calling the call in 



TM00-004 US Application doc 



22 



Attorney Docket Number TM00-004 US 



number to select from the available applications. Note, however, that according to some 
embodiments of the invention, a given phone application can invoke another phone 
application. In such embodiments, a developer can always develop a "menu" application and 

register that as the URI where the menu application provides prompting at the call in number 
5 302 to select among the developers applications. Of course, it is possible for the developer 
herself/himself to launch other phone applications using appropriate commands, e.g. 
<GOTO> and <GOSUB>. 

2. In Browser/Scratchpad Based Development 

In a similar vein, at step 706, the developer can perform in browser, or scratchpad, 

10 based development. Figure 3 shows the scratchpad 306 in its collapsed state. Figure 4 shows 

that after following the scratchpad link, a text entry field appears for development. In some 
embodiments, the scratchpad is an HTML form element. According to other embodiments, it 
is a Java(TM), Javascript(TM), or other browser based scripting language, based program that 

supports text editing with the file data stored on a remote host, e.g. the development platform 
15 web server 1 08, or other suitable remote host. Text can be input directly in the scratchpad area 
or alternatively, text can be entered into the scratchpad using the cut-and-paste facilities of the 
developer's local computer environment. 

According to the embodiment shown in Figures 3 and 4, the scratchpad and URI based 

development options are mutually exclusive. Thus, in this embodiment, the developer either 
20 works from the scratchpad or she/he works on a text file hosted on a web server, e.g. the 
application file 114, and specifies the URI. According to one embodiment of the invention, 
selecting between these modes simply selects whether the scratchpad application or the URI 
application is "live" on the phone application platform 110. This allows the developer to test 
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short code segments using the scratchpad, incorporate them into her/his application file, and 

then switch back to URI based development mode and find the URI unchanged. Similarly, on 
switching back to the scratchpad, the scratchpad contents may be preserved. 

3. Syntax Checking 

5 Another useful part of application development is syntax checking. Because 

VoiceXML is an interpreted language there is no compilation process such as with C for 
detecting invalid structures. 

At step 706, the developer can request that her/his application be syntax checked. 

Importantly, this syntax checker may actually perform multiple tasks beyond verifying the 
10 well-formedness of the VoiceXML code. In some embodiments, the syntax checker verifies 

the application file against the document type definition (DTD) specified in the application 
file. In some embodiments, an outline style parsed view of the application is presented 

responsive to the syntax checking. This view is visible in standard web browsers, e.g. Internet 
Explorer(TM), and allows the developer to review any syntax errors as well as view her/his 
1 5 application as a hierarchical outline of containers. 

Other features that can be included in the syntax checking include grammar 
verification, e.g. test compile any developer provided grammar, with feedback provided to the 
developer. Similarly, to the extent possible, inline scripts within the phone application, e.g. in 
a language such as Javascript(TM), can be syntax checked. 

20 4. Debugging or Call Flow 

The colloquial term "debugging" is sometimes used to refer to the call flow output. 
The call flow output provides important benefits for phone application development because 
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it allows a developer to understand how her/his application is behaving. This can be enhanced 
by providing call flow information concurrently with phone calls to the phone application 

platform 110. 

By concurrent it is meant that the information about the execution of the phone 
5 application is available on the phone application platform to a developer as a telephone call 
takes place. Thus, as a phone application transitions from a first state to a second state, that 

information is available to the developer while she/he is on the phone using the application. 

Similarly, the results of speech recognition can be shown, thus the developer can distinguish 

between a speech recognition error and a program logic error easily, hi some embodiments 
10 the concurrency is in near real time with the call flow, or debugging, output being provided 

over an HTTP connection to the developer's computer, e.g. the computer 102, with only a 

minimal amount of delay, e.g. frequently less than a second, network conditions permitting. 
The call flow information tracks a flow of execution for a phone call. Thus, even as 

file boundaries in the phone application are hit, the call flow information can continue to track 
1 5 the progress of the application. This is useful because it may be desirable to split an 

application into multiple files for code factoring, code sharing, and/or other purposes. 

Similarly, for any given phone call, the amount of call flow information shown to the 

developer may be controlled by setting options at step 710. In the example of Figure 6, a 

series of check boxes, reference numeral 602, are used to select which classes of debugging 
20 information are output. Some embodiments of the invention define six classes of debugging 
information: 

Errors: Errors represent compile-time and run-time errors in preparing the 
application for execution or executing the application. In some 
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instances these errors could have been detected according to the syntax 
checking of step 708. In some embodiments of the invention, this type 
of error cannot be disabled in the call flow log. 

General Flow Trace: This allows the developer to follow the phone 

application state transitions as VoiceXML containers are entered and/or 

exited. 

Event Trace; This allows the developer to follow the phone application 

events. In particular, VoiceXML uses events and event handlers to 

implement certain functions. This debugging class allows developers to 

see which events are being "thrown" and where and how they are being 
"caught", if at all. 

Field Fill Trace: This allows developers to track the results of fields being 
filled. In particular, VoiceXML uses a form-field metaphor together 
with filling to receive information from users. This debugging class 
allows the developer to see which fields are being filled and with what 
contents. 

Variables Trace: This allows developers to track the setting and reading of 
variables. This is useful for monitoring internal application state. For 
applications of suitable complexity this is extremely important for 
being able to review the program logic and function. 

Custom Trace: Although not shown in the embodiment of Figure 6, some 
embodiments output developer defined custom messages. In some 
embodiments, suitable extensions to VoiceXML are provided to 
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support debugging, e.g. <DEBUG>output string</DEBUG> along with 
suitable Javascript(TM) functions, where appropriate, e.g. vxmllog(). 
The specific classes of call flow information made available to developers are selectable by 
the operator of the remotely hosted phone application development environment. They can be 

5 customized to the needs of phone application developers as well as the specific language 
and/or platform features and extensions. 

Another feature of the development environment is that some embodiments can 
support multiple calls to a single application simultaneously. For that reason a call selector 
600 is provided in some embodiments to control which telephone call the debugging output is 

10 shown for. To support this feature, some embodiments notify a caller when they dial the call 

in number 302 of their "call number", e.g. "123". The developer can use that information at 
step 710 to select only that call. 

At step 712, the debugging information is displayed. This state can be reached directly 
from step 702, as well as step 710, according to some embodiments of the invention. The 

15 basic debugging format is for an HTTP capable server, e.g. the development platform web 
server 108, the phone application platform 1 10, or other server, to provide the call flow 
information over an HTTP connection to a browser window opened by (or for) the developer, 
e.g. on her/his computer 102. The debugging information can be delivered in a XML format, 
e.g. HTML or a specific debugging XML format. 

20 The call flow output for the sample application at the URI indicated in Figure 3 is 

shown in Figure 5 for the first portion of the telephone call. The top portion of the call flow 
window provides general information, e.g. call in number 302, an indicator 500 of which call 
the information shown applies to, etc. When in "all calls" mode, the call flow information 
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from multiple calls can be displayed interspersed with one another. Suitable call number 

identifiers can be prefixed in front of the output to indicate the corresponding call to which 
the output applies. 

The call flow information follows in a color-coded format, reference numeral 502. 
5 Color-coding is used in some embodiments of the invention to differentiate between the 

different classes of call flow information, with one color for each class. This makes it easier to 

review a log and monitor it since the different classes of information are colored differently. 

New information can be added at the bottom, or at the top in some embodiments, and where 
; = p{ appropriate the browser sc roll position can be automatically adjusted to keep the most current 

f [p 10 debugging information in the viewed portion of the window. Still other embodiments do not 
i'U automatically scroll the window to allow the developer to review the log without it "moving" 

away from what she/he is looking at. Still other formats are possible, for example, like the 
i;n syntax checking feature, an outline style view could be used that allows the log to be 

UJ collapsed in logical groups. 

; s - s 15 For example, some embodiments support real-time call flow visualization. This takes 

information from the phone application platform and presents both the call flow information 
visually as the developer is interacting with the application on the phone. This visualization 
can both highlight regions in the code that are being interpreted, present a higher-level 
visualization of the application as a visual call flow, and/or provide other visualization 
20 information that helps a developer understand her/his program. 

5. Developer Tools Needed and Useful Features 

A developer does not need any specialized software or hardware to develop phone 
applications using the remotely hosted phone application development environment. She/he 
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needs only a computer, e.g. the computer 102, a web browser (for scratchpad only 

development), access over a network, e.g. the Internet, to the development platform web 
server 108, and a telephone to test her/his applications. If more serious applications are being 
developed, the developer may want a text editor and will also need access to a web server of 
her/his own to store the applications and any associated sound files. Both setups provide 

zero-footprint development. 

In order to further assist developers, the operator of the remotely hosted development 
environment may make a number of modules, or other reusable code segments, available to 
developers. Some embodiments of the invention provide the following types of resources to 

developers; an audio library, a grammar library, and an application library. 

The audio library may include shared audio files that can be referenced by 
applications. These might include useful sounds like times, e.g. "10:10" pronounced by an 

announcer as opposed to a speech synthesizer, earcons — auditory icons — that are used to 
provide cues to the end user, and/or other audio files. 

The grammar library includes opaque grammars for developer access. The term 

opaque indicates that the developer is not necessarily provided source level access to the 

grammar. Rather, the developer accesses the grammar by referencing its name, as such: 

<grammar> 

< ! [ CDATA [ 

GrammarName 
1 ] > 
</grammar> 

Using this approach, a company can safely provide complex grammars to developers without 
revealing the implementation. Some embodiments include grammars for: commands (yes/no 
with variations), credit card related grammars (card number and expiration date grammars), 
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date and time grammars (time and date input as well as duration input), financial grammars 
(currency inputs), location grammars (city/state input), number grammars (entry of natural 

numbers, percents, social security numbers), and phone grammars (telephone number input). 

This approach is more flexible than simply providing a URI in the "src" element of the 
5 <GRAMMAR> tag as it allows combinations of grammars to be selected by the developer, 
e.g. SEVEN DIGIT PHONE NUMBER or TEN DIGIT PHONE NUMBER, by simply 

listing both grammar names. 

These grammars are typically heavily developed to recognize many variations and 
alternate forms. For example, the credit card number grammar provided supports 15 and 16 

10 digit credit card numbers and supports natural clusters with each four-digit group as well as 
DTMF, or touch-tone, input. Thus, for example for the fragment of a credit card number 
"1800 1234" the end user could say "eighteen hundred" and then say "one two three four", 
etc. Further, the use of a common grammar allows the developer to focus her/his development 
efforts on the application specific logic and allows the developer to leverage refinements in 

1 5 the underlying grammars, e.g. upgrades to the credit card grammar to recognize more 
variations. 

Similarly, a module format has been developed that allows developers to access 
opaque phone application code. A namespace of variable names is selected for module inputs, 

e.g. session.toolbox.*, Variables within that space are specific to the provided modules. 

20 A developer can then use modules by assigning values to the appropriate module 

inputs, e.g. <assign name- 'session.toolbox.daydate.date" expr="'4/9/00"7>, and then calling 
the module code, e.g. <gosub 

next= M http://resources.tellme.com/toolbox/daydate/date_module.vxmr ! >. The module will 
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throw predefined events to report any successes/failures as well as set any appropriate 
variables with output information. 

To preserve module opacity, the server hosting the module can be programmed to only 
allow HTTP requests for the module from specified servers, e.g. the phone application 
5 platform 110. Thus, the developer could not use the computer 102 to retrieve the designated 

module file. Like the grammar library, this allows the developer to leverage well-developed 
tools for certain tasks and focus her/his development efforts on their application's logic. 

Some modules provided by embodiments of the invention include: a date module for 
pronouncing dates using recorded speech in a variety of formats (e.g. with/without day of 

10 week), a time module for pronouncing times using recorded speech in a variety of formats 

(e.g. account for timezone, convert 24/12 hour time, etc.); a time duration module for 

pronouncing periods of time using recorded speech in a variety of formats (e.g., hours, 
minutes, seconds, days, etc.); a phone number module for playing back a phone number using 

recorded audio; a prices module for playing back a price using recorded audio; and a city-state 
15 module for pronouncing city and state names using recorded audio. 

When Javascript(TM) is used in conjunction with VXML, some opaque methods and 

properties may be available from within Javascript(TM) such as: a caller-geography object 

(provides opaque access to telephone identifying inforaiation and related information, e.g. 

city name, state, timezone, etc.); a city-state/zip code translator (translates from zip codes to a 
20 city/state and vice-versa), a multi-value grammar parser (useful if a grammar returns an 

aggregate value in a single variable, this will parse the return value into multiple session 

variables), a session variable copier with list support (copies one session variable to another 

while copying the whole list). 
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The specific modules and capabilities provided reduce development costs and time. In 

internal testing, it has been found that non-programmers can prototype complicated electronic 

commerce-oriented applications quickly. That is because normally hard-to-program features 

have been modularized, e.g., locations, credit card numbers, etc. As the libraries are expanded 
5 this rapid application development capability will only increase. 

6. Converting Web Based Applications 

Embodiments of the invention allow the developed phone application to interact, e.g. 

using CGI, HTTP requests, anchor other mechanisms, with other web-based systems. 
Accordingly, if a company has web-based applications, they can typically be interfaced with a 
10 phone application through porting of the front end, e.g. the HTML content to VoiceXML. 

Doing this well can be a large task and the ability to share the common backend systems used 

for the web based applications reduces the cost of conversion and ongoing maintenance. 

Some embodiments of the invention support a Phone Application State Management 
Mechanism that allows a developer to get and store state within their phone application. In 
15 some instances, this mechanism may provide compatibility with existing web-based standards 
for state management to further reduce porting costs. 

Similarly, the phone application platform 110 can support the execution of 
dynamically generated applications, e.g. where a CGI, or other program, on a web server is 
dynamically provides the content of the executed application. 

20 E. Conclusion 

A zero-footprint remotely hosted phone application development environment is 
described. The environment allows a developer to use a standard computer without any 
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specialized software (in some embodiments all that is necessary is a web browser and network 
access) together with a telephone to develop sophisticated phone applications that use speech 

recognition and/or touch tone inputs to perform tasks, access web-based information, and/or 
perform commercial transactions. 
5 Once the source code of phone application is identified to the development 

environment, the developer can use a telephone to immediately call the application on the 
hosted development environment. Some embodiments support concurrent call flow tracking 
that allows a developer to observe, using a web browser, the execution of her/his application. 
A variety of reusable libraries are provided to enable the developer to leverage 

10 well-developed libraries for common playback, input, and computational tasks. This focuses 
the development on application specific logic. Embodiments of the invention simplify the 

process of defining speech recognition grammars within their applications. Embodiments of 
the invention support rapid application deployment from the development environment to 
hosted application deployment to the intended audience. Further, because the development 
IS environment can be configured to behave identically (language extensions, features, etc.) to 
the hosting environment, there are no surprises due to incompatibilities. 

In some embodiments, phone application platform 110 and the development platform 

web server 108 can be hardware based, software based, or a combination of the two. In some 

embodiments, phone application platform 110 and/or the development platform web server 
20 108 are comprised of one or more computer programs that are included in one or more 

computer usable media such as CD-ROMs, floppy disks, or other media. In some 

embodiments, call manager programs, execution engine programs, data connectivity engine 

programs, evaluation engine programs, streaming subsystem programs, recognition server 
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programs, text to speech programs, syntax checking programs, call flow monitoring programs, 
and/or scratchpad programs, are included in one or more computer usable media. 

Some embodiments of the invention are included in an electromagnetic wave form. 
The electromagnetic waveform comprises information such as call manager programs, 
5 execution engine programs, data connectivity engine programs, evaluation engine programs, 

streaming subsystem programs, recognition server programs, text to speech programs, syntax 

checking programs, call flow monitoring programs, and/or scratchpad programs The 
electromagnetic waveform may include the programs accessed over a network. 

The foregoing description of various embodiments of the invention has been presented 
10 for purposes of illustration and description. It is not intended to limit the invention to the 
precise forms disclosed. Many modifications and equivalent arrangements will be apparent. 
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CLAIMS 

What is claimed is: 

1 1 . A method of supporting development of a phone application code for a computer . 

2 based phone application platform having a network interface and a telephone interface, the 

3 method comprising: 

4 receiving over the network interface from a remote computer the phone application 

5 code; 

6 associating the phone application code with a telephone number for communicating 

7 with the telephone interface; and 

8 responsive to receiving a telephone call via the telephone number, executing the phone 

9 application code and presenting an audio output over the telephone interface and 
10 presenting a call flow to the remote computer over the network interface. 

1 2. The method of claim 1, wherein the call flow shows the flow of program control in the 

2 phone application code during the telephone call. 

1 3. The method of claim 1, wherein the call flow includes information for debugging the 

2 phone application code. 

1 4. The method of claim 1, wherein the call flow concurrent with execution of phone 

2 application code on the computer based phone application platform. 

1 5 . The method of claim 1 , wherein the receiving comprises receiving an HTTP request 

2 including form data, the form data comprising the phone application code. 
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1 6. The method of claim 1 , wherein the computer based phone application platform 

2 operated by a first legal entity and wherein the remote computer operated by a second legal 

3 entity different from the first legal entity. 

1 7. A method of supporting development of a phone application code for a computer 

2 based phone application platform having a network interface and a telephone interface, the 

3 method comprising: 

4 receiving over the network interface from a remote computer the phone application 

5 code; 

6 associating the phone application code with a telephone number for communicating 

7 with the telephone interface; and 

8 responsive to receiving a telephone call via the telephone number, executing the phone 

9 application code and presenting an audio output over the telephone interface. 

1 8. The method of claim 7, wherein the executing further comprises presenting a call flow 

2 to the remote computer over the network interface. 

1 9. The method of claim 7, wherein the remote computer does not include specialized 

2 phone application development software. 

1 10. A method of supporting development of a phone application code for a computer 

2 based phone application platform having a network interface and a telephone interface, the 

3 method comprising: 

4 receiving over the network interface from a remote computer a reference to the phone 

5 application code; 

6 associating the phone application code with a telephone number for communicating 

7 with the telephone interface using the reference; and 
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8 responsive to receiving a telephone call via the telephone number, executing the phone 

9 application code and presenting an audio output over the telephone interface and 
10 presenting a call flow to the remote computer over the network interface. 

1 11. The method of claim 1 0, wherein the reference comprises a uniform resource locator 

2 (URI). 

1 12. The method of claim 10, wherein the executing further comprises retrieving the phone 

2 application code from the reference over the network interface. 

1 13. The method of claim 10, wherein the call flow concurrent with execution of phone 

2 application code on the computer based phone application platform. 

1 14. The method of claim 1 0, wherein the computer based phone application platform 

2 operated by a first legal entity and wherein the remote computer operated by a second legal 

3 entity different from the first legal entity. 

1 15. A method of supporting remotely hosted phone application development for a phone 

2 application platform using a first computer system, the^first computer system supporting a 

3 web interface, the method comprising: 

4 receiving over the web interface a uniform resource identifier (URI) from a second 

5 computer system, the URI corresponding to the location of a phone application; 

6 responsive to the receiving the URI, sending a first message to the phone application 

7 platform using the first computer system, the first message corresponding to a 

8 request to make the phone application located at the URI available on the phone 

9 application platform at a telephone number; and 

10 upon receiving a request from the second computer system on the first computer 

1 1 system, presenting to the second computer a debugging information generated by 



TM0O-0O4 US Application doc 



37 



Attorney Docket Number TMOO-004 US 



12 calls to the telephone number for the phone application on the phone application 

13 platform. 

1 16. The method of claim 15, further comprising sending a second message to the second 

2 computer system, the second message indicating the telephone number for accessing the 

3 phone application on the phone application platform; 

1 17. The method of claim 15, wherein the presenting updated with execution of the phone 

2 application on the phone application platform. 

1 18. The method of claim 1 5, wherein the presenting provides the debugging information 

2 in an extensible markup language (XML). 

1 19. The method of claim 15, wherein the presenting capable of selecting the debugging 

2 information for a particular ongoing execution of the phone application on the phone 

3 application platform. 

1 20. The method of claim 15, wherein the presenting capable of selecting the debugging 

2 information for all ongoing executions of the phone application on the phone application 

3 platform. 

1 2 L The method of claim 1 5 , further comprising a web interface for controlling debugging 

2 output by the phone application platform for the phone application. 

1 22. The method of claim 21, wherein the controlling debugging output comprises 

2 selecting one or more or debugging output from phone application states, phone application 

3 events, phone application field fills, phone application variables, and custom debugging 

4 messages. 
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1 23. The method of claim 15, wherein the debugging information in the XML comprises a 

2 hypertext markup language with color coded messages, and wherein different colors are used 

3 for different types of messages. 

1 24. The method of claim 15, wherein responsive to the sending the first message, the 

2 phone application platform configured to retrieve and execute the phone application at the 

3 URI responsive to a call to the telephone number. 

1 25. The method of claim 24, wherein the phone application platform configured to execute 

2 the phone application responsive to receipt of an identifier at start of a call to the telephone 

3 number. 

1 26. The method of claim 24, wherein the phone application provided by a developer 

2 having a corresponding identifier, and wherein the phone application platform configured to 

3 execute the phone application responsive to receipt of the identifier at start of a call to the 

4 telephone number. 

1 27. The method of claim 1 5, wherein the phone application comprises an application 

2 written in an XML-based voice application language. 

1 28. An apparatus for developing a phone application code, the apparatus comprising: 

2 a network interface for receiving a reference to the phone application code; 

3 a telephone interface to send and receive audio signals to and from the telephone; and 

4 a control subsystem to control the Internet interface and the telephone interface, the 

5 control subsystem including at least one program for 

6 receiving over the network interface from a remote computer a reference to the 

7 phone application code; 
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8 associating the phone application code with a telephone number for 

9 communicating with the telephone interface using the reference, and 

10 responsive to receiving a telephone call via the telephone number, executing the 

1 1 phone application code and presenting an audio output over the telephone 

12 interface and presenting a call flow to the remote computer over the network 

13 interface. 

1 29. An apparatus for remotely hosted phone application development, the apparatus 

2 comprising: 

3 means for receiving over a web interface a uniform resource identifier (URI) from a 

4 computer system, the URI corresponding to the location of a phone application; 

5 means for sending a first message to a phone application platform responsive to the 

6 receiving the URI„ the first message corresponding to a request to make the phone 

7 application located at the URI available on the phone application platform at a 

8 telephone number; and 

9 means for presenting to the second computer a call flow information generated by 

1 0 calls to the telephone number for the phone application on the phone application 

1 1 platform upon receiving a request from the computer system. 
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ABSTRACT 

A zero-footprint remotely hosted phone application development environment is 
described. The environment allows a developer to use a standard computer without any 
specialized software (in some embodiments all that is necessary is a web browser and network 
5 access) together with a telephone to develop sophisticated phone applications that use speech 
recognition and/or touch tone inputs to perform tasks, access web-based information, and/or 
perform commercial transactions. For example, in preparation for a sales pitch for selling 
hosting services, a non-programmer can develop a short application appropriate to the target 
customer. After the pitch, access to the demonstration could be given to the target customer to 

10 allow them to more fully develop the application. When the target customer is satisfied with 
the application, they can have their application live for their actual (as opposed to test users) 
at a suitable phone number simply by having the hosting provider configure the appropriate 
access. Once the source code of phone application is identified to the development 
environment, the developer can use a telephone to immediately call the application on the 

15 hosted development environment. Some embodiments support concurrent call flow tracking 
that allows a developer to observe, using a web browser, the execution of her/his application. 
A variety of reusable libraries are provided to enable the developer to leverage 
well-developed libraries for common playback, input, and computational tasks. This focuses 
the development on application specific logic. Embodiments of the invention simplify the 

20 process of defining speech recognition grammars within their applications. Embodiments of 

the invention support rapid application deployment from the development environment to 

hosted application deployment to the intended audience. 
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